Image recording and editing apparatus, and method for capturing and editing an image

ABSTRACT

An image editing apparatus includes a recording medium for recording an image file and a scenario file, wherein the scenario file is formed by recording a replay order or a replay condition of the image file with a predetermined file format, a scenario evaluating circuit for reading the scenario file from the recording medium and evaluating the replay order or the replay condition, an editor for editing the image file in response to an evaluation by the scenario evaluating circuit, and a recorder for recording the image file on the recording medium.

[0001] This application claims the benefit of Japanese Patentapplications No. 09-001865, filed in Japan on Jan. 9, 1997, JapanesePatent application No. 09-82570, filed in Japan on Apr. 1, 1997, andU.S. provisional application Ser. No. 60/053,426, filed on Jul. 22,1997, all of which are hereby incorporated by reference

BACKGROUND OF THE INVENTION

[0002] 1. Field of the Invention

[0003] The present invention relates to an image editing apparatus forediting an image file on a recording medium, and more particularly, to aportable image editing apparatus for editing image data, such as aportable camera.

[0004] 2. Discussion of the Related Art

[0005] Recently, through developments in digital image processing usingcomputer technology, image editing apparatuses that edit image files ona recording media have been implemented. One example of such an imageediting apparatus is a device in which several image files are connectedmanually into a single image product.

[0006] In this kind of editing operation, an operator first categorizesa plurality of image files into several scenes corresponding to anintended production. Next, the image files are connected to eachindividualized scene by using the image editing apparatus. The finalimage product is completed by further connecting the intermediate levelsof image files for each scene.

[0007] However, since the image files in intermediate levels are made bysuperimposition, the image editing apparatus must include a largecapacity recording medium.

[0008] If the image editing apparatus is portable, such as an electroniccamera with an integral image editor, it is difficult to provide alarge-capacity recording medium, since portability and small size aredesirable. As a result, attaching a complicated image editing functionis too complex for an electronic camera with an integral image editingapparatus.

[0009] It is also possible to delete the original image file each timean intermediate-level image file is made in order to conserve space onthe recording medium. However, with this approach, the revision ofedited work becomes difficult, since the original image file is deleted.Additionally, a single image file cannot be flexibly used in editingoperations, such as for reusing the image file for a plurality ofscenes.

SUMMARY OF THE INVENTION

[0010] Accordingly, the present invention is directed to an imageediting apparatus that substantially obviates one or more of theproblems due to the limitations and disadvantages of the related art.

[0011] One object to the present invention is to provide an imageediting apparatus that can edit a plurality of image files flexibly, andat the same time effectively use the recording capacity of the recordingmedium.

[0012] Another object of the present invention is to simplify a filestructure of an image editing apparatus.

[0013] Another object of the present invention is to provide an imageediting apparatus that has a high recyclability of scenario files.

[0014] Another object of the present invention is to provide an imageediting apparatus that can easily make the scenario file.

[0015] Another object of the present invention is to provide an imageediting apparatus that can make a complex and high-level scenario file.

[0016] Another object of the present invention is to provide an imageediting apparatus that can edit an image file even when the content ofthe scenario file has an inconsistency.

[0017] Another object of the present invention is to provide an imageediting apparatus that can confirm the result of the image editinginstantly even when in the middle of image editing.

[0018] Additional features and advantages of the present invention willbe set forth in the description which follows, and will be apparent fromthe description, or may be learned by practice of the invention. Theobjectives and other advantages of the invention will be realized andattained by the structure and process particularly pointed out in thewritten description as well as in the appended claims.

[0019] To achieve these and other advantages and according to thepurpose of the present invention, as embodied and broadly described, inaccordance with a first aspect of the present invention there isprovided an image editing apparatus including a recording medium forrecording an image file and a scenario file, wherein the scenario fileis formed by recording a replay order or a replay condition of the imagefile with a predetermined file format, a scenario evaluating circuit forreading the scenario file from the recording medium and evaluating thereplay order or the replay condition, and an editor for editing theimage file in response to an evaluation by the scenario evaluatingcircuit.

[0020] In another aspect of the present invention, there is provided animage recording and editing apparatus including a camera, a recordingmedium, a recorder, a display for displaying images received by thecamera, a controller for controlling the display in response to ascenario file, wherein the images are recorded on the recording mediumas image files by the recorder in response to commands from thecontroller and instructions stored in a scenario file.

[0021] In another aspect of the present invention there is provided animage recording and editing apparatus including a camera, an imagememory for storing images received by the camera and connected to acommon data bus, a recording medium, a disk drive positioned to recorddata on the recording medium and connected to the common data bus, adisplay for displaying images received by the camera, a display driverfor driving the display and connected to the common data bus, amicroprocessor connected to the common data bus for controlling thedisplay in response to a scenario file, wherein the images are recordedon the recording medium as image files by the recorder in response tocommands from the controller and instructions stored in a scenario file,and a compression/decompression circuit connected to the common databus.

[0022] In another aspect of the present invention, there is provided amethod of capturing and editing images, including the steps of capturinga first image, storing the first image on a recording medium, creating acontrol instruction, storing the control instruction as a scenario file,and displaying the first image, wherein the first image is modifiedaccording to the scenario file.

[0023] In another aspect of the present invention, there is provided animage reproducing apparatus including a memory for storing an image fileincluding moving image data and a scenario file, wherein the scenariofile includes a reproduction start point and a reproduction end point ofthe moving image data of the image file, and a reproducer forreproducing the moving image data in accordance with the reproductionstart point and the reproduction end point.

[0024] In another aspect of the present invention, there is provided animage reproducing apparatus, including an image file including movingimage data, a reproduction start point of the moving image data, and areproduction end point of the moving image data, a memory for storingthe image file; and a reproducer for reproducing the moving image datain accordance with the reproduction start point and the reproduction endpoint.

[0025] In another aspect of the present invention, there is provided animage reproducing apparatus, including a memory for storing moving imagedata, a reproduction start point of the moving image data, and areproduction end point of the moving image data, and a reproducer forreproducing the moving image data in accordance with the reproductionstart point and the reproduction end point.

[0026] It is to be understood that both the foregoing generaldescription and the following detailed description are exemplary andexplanatory and are intended to provide further explanation of theinvention as claimed.

BRIEF DESCRIPTION OF THE ATTACHED DRAWINGS

[0027] The accompanying drawings, which are included to provide afurther understanding of the invention and are incorporated in andconstitute a part of this specification, illustrate embodiments of theinvention that together with the description serve to explain theprinciples of the invention.

[0028] In the drawings:

[0029]FIG. 1 is a basic operational block diagram of a preferredembodiment of the present invention;

[0030]FIG. 2 is another operational block diagram of the preferredembodiment of the present invention illustrating a replay operation;

[0031]FIG. 3 is another operational block diagram of the preferredembodiment of the present invention illustrating creation of a scenariofile;

[0032]FIG. 4 is another operational block diagram of the preferredembodiment of the present invention illustrating resolution of ascenario file inconsistency;

[0033]FIG. 5 is another operational block diagram of the preferredembodiment of the present invention illustrating a replay mechanism;

[0034]FIG. 6 is a schematic block diagram of the preferred embodiment ofthe present invention;

[0035]FIG. 7 shows an isometric view of a physical structure of thepreferred embodiment of the present invention;

[0036]FIG. 8 is a state diagram showing the operation of the preferredembodiment of the present invention;

[0037]FIG. 9 is a flow chart showing the operation of the edit screen B;

[0038]FIG. 10 is a flow chart showing the operation of the edit screenC;

[0039]FIG. 11 is a flow chart showing the operation of the edit screenD;

[0040]FIG. 12 is a flow chart showing the operation of the edit screenE;

[0041]FIG. 13 is a flow chart showing the operation of the replay mode;

[0042]FIG. 14 is a flow chart showing the operation of the video editscreen;

[0043]FIG. 15 shows the initial screen;

[0044]FIG. 16 shows the edit screen A;

[0045]FIG. 17 shows the edit screen B;

[0046]FIG. 18 shows the edit screen C;

[0047]FIG. 19 shows the edit screen D;

[0048]FIG. 20 shows the edit screen E;

[0049]FIG. 21 shows a display screen at the time of replay mode inconjunction with an image on the display;

[0050]FIG. 22 shows a video edit screen;

[0051]FIG. 23 shows a data structure of a scenario file; and

[0052]FIG. 24 shows the hierarchical structure for replay order.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0053] Reference will now be made in detail to the preferred embodimentsof the present invention, examples of which are illustrated in theaccompanying drawings.

[0054]FIG. 1 is an operational block diagram of a preferred embodimentof the present invention. A recording medium 1 is used for recording aplurality of image files and a scenario file formed by recording areplay order of the image file or a replay condition with apredetermined file format. A scenario evaluating circuit 2 receives thescenario file from the recording medium 1 and evaluates the replay orderor the replay condition. An editor 3 edits an image file received fromthe recording medium according to the replay order or the replaycondition. A recorder 4 records the image file edited by the editor tothe recording medium.

[0055] The replay condition in the scenario file can be a replay speedof the image files, a number of replay repetitions of the image files, areplay range of the image files, a special effect added to the replay ofthe image files, or a replay condition of sound associated with theimage file.

[0056] Identification data indicating other scenario files is recordedas data indicating a replay order. A scenario evaluating circuit 2follows the corresponding scenario file in steps based on theidentification data recorded in the scenario file, and evaluates thereplay order of the image files.

[0057]FIG. 2 is another operational block diagram of the image editingapparatus including a manual replay circuit 5 that replays image filesrecorded on the recording medium 1 in response to an external replayoperation command, and a first scenario making editor 6 thatautomatically records the replay order or the replay condition throughthe manual replay circuit.

[0058]FIG. 3 is another operational block diagram of the image editingapparatus showing an edit input unit 7 that receives an editingoperation for a plurality of image files, and a second scenario makingeditor 8 that records a replay order or a replay condition as thescenario file based on the editing operation that was input to the editinput unit 7.

[0059]FIG. 4 is another operational block diagram showing a handling ofinconsistencies between a plurality of replayed image files and acorresponding scenario file. The corrector 9 corrects theinconsistencies according to a pre-determined priority order or anexternal correction order.

[0060]FIG. 5 is an operational block diagram illustrating that thereplay mechanism 10 replays the image file input from the recordingmedium according to the replay order or replay condition evaluated by ascenario evaluating circuit 2.

[0061] In the image editing apparatus of the preferred embodiment, thescenario evaluating circuit 2 reads out the scenario file from therecording medium 1. The replay order or the replay condition has beenpreviously recorded in the scenario file with a predetermined fileformat.

[0062] The scenario evaluating circuit 2 evaluates the replay order orthe replay condition based on this file format. The editor 3 edits theimage file stored on the recording medium 1 according to the replayorder or the replay condition determined by the scenario evaluatingcircuit 2. The recorder 4 records the edited image file on the recordingmedium 1.

[0063] The image editing apparatus 2 has recorded in the scenario file,as the replay condition, either a replay speed of the image files, anumber of replay repetitions of the image files, a replay range of theimage files, a special effect associated with the replay of the imagefiles, or a replay condition of sound associated with the image files.

[0064] The scenario evaluating circuit 2 evaluates the replay order ofthe image files by following the scenario file in a hierarchical manner.

[0065] Since a complicated replay order is reproduced by following aplurality of scenario files in a hierarchical manner, the file structurefor each scenario file is simplified. Moreover, since it is possible tointegrate the already-edited scenario file into another scenario file,it is simple to reuse a particular scenario file.

[0066] The scenario file may be created automatically by recording amanual replay operation. Alternatively, the scenario file may be basedon an editing operation. Any inconsistencies in the scenario file arecorrected based on either a predetermined priority order or externalcorrection instructions. The replay mechanism 10 replays the image filesstored on the recording medium 1 by following the replay order or thereplay condition evaluated by the scenario evaluating circuit 2.

[0067]FIG. 6 is a schematic block diagram of a physical implementationof the preferred embodiment, and FIG. 7 is an isometric view of anexternal appearance of the physical implementation of the preferredembodiment. In FIGS. 6 and 7, a disk drive 12 is located within an imageediting apparatus 11, and a recording medium 13 (such as, for example, amagneto-optical disk) is inserted into the disk drive 12 from theoutside. The disk drive 12 is connected to a microprocessor 14 through acommon data bus 14 a. An image compression/ decompression circuit 15, animage memory 16 and a display driver 17 are connected to the common databus 14 a.

[0068] The image output of the display driver 17 is connected to aliquid crystal display 18 positioned in front of the image editingapparatus 11. A touch panel 18 a is affixed to the liquid crystaldisplay 18, to sense the touch of a finger or a pen, and the output ofthe touch panel 18 a is connected to a touch panel detecting circuit 19.The output of the touch panel detecting circuit 19 is outputted to themicroprocessor 14.

[0069] A rotatable camera 11 a is positioned on a side of the imageediting apparatus 11. A photographic lens 21 is attached to a front faceof the rotatable camera 11 a. A light receiving component of an imagingelement 22 is positioned at an image forming plane of the photographiclens 21. Photoelectric output of the imaging element 22 is connected viaan A/D converter to a signal processor 24 that performs correction andcolor signal processing. Output of the signal processor 24 is input toan image memory 16 via a mechanical and electrical connection (notshown) between the camera 11 a and the image editing apparatus 11.

[0070] A speaker 11 d and an earphone jack 11 e are positioned on thebody of the image editing apparatus 11, and connected to an internaloutput amp (not shown) for sound effects.

[0071] The scenario evaluating circuit 2 performs the function ofevaluating the data structure of the scenario file stored on the diskdrive 12. The microprocessor 14 and the editor 3 perform the function ofediting a plurality of image files based on the scenario file stored onthe disk drive 12. The image compression/decompression circuit 15, themicroprocessor 14, and the recorder 4 perform the function of recordingconnected edited image files stored on the disk drive 12 and themicroprocessor 14. The manual replay circuit 5 performs the function ofreplaying image files corresponding to the manual replay operation ofthe touch panel 18 a. The touch panel detecting circuit 19, themicroprocessor 14, and the first scenario making editor 6 perform thefunction of making the scenario file data according to the replayoperation of the microprocessor 14. The edit input unit 7 performs thefunction of evaluating the editing operation of the touch panel 18 a,the touch panel detecting circuit 19 and the microprocessor 14. Thesecond scenario making editor 8 performs the function of creatingscenario file data according to the editing operation of themicroprocessor 14.

[0072] The corrector 9 performs the function of resolvinginconsistencies in the scenario file. Finally, the replay mechanism 10performs the function of replaying a plurality of image files based onthe scenario file via the display driver 17, the liquid crystal display18 and the microprocessor 14.

[0073]FIG. 8 is a state diagram illustrating the operation of thepreferred embodiment. FIGS. 9-14 are flow charts explaining theoperation of the preferred embodiment. FIGS. 15-22 show display screensproduced by the preferred embodiment. The operation of the preferredembodiment will be explained in conjunction with a transition of thedisplay screen of the liquid crystal display 18.

[0074] When the power is turned on, the microprocessor 14 displays aninitial screen (shown in FIG. 15) on the liquid crystal display 18 viathe display driver 17. In the initial screen, a sub-window 30 forreceiving the replay operation is displayed, and thumbnail images 31 aredisplayed in an upper half of the sub-window 30.

[0075] The thumbnail images 31 are, for example, images that give areduced display of the leading frames of the image files recorded on therecording medium 13. An image with a scenario file identification mark32 is displayed along with the thumbnail images 31 that represents thescenario file. For example, the leading frame of the image file relatedto the scenario file is displayed in reduced form.

[0076] Below the thumbnail images 31, a scroll button 33 is shown forscrolling the thumbnail images 31 outside of the screen. Below thescroll button 33 a replay button 34 is shown for commanding the replayoperation. Below the replay button 34, an editing button 35 isdisplayed. When the editing button 35 is clicked on (actuated) by afinger or the like, the touch panel 18 a senses an actuation, such as,for example, pressure change. The touch panel detecting circuit 19detects a position coordinate of a point of contact on the touch panel18 a and sends it to the microprocessor 14. The microprocessor 14 sendsa message “the editing button has been actuated” to the display driver17 based on the position coordinate of the point of contact. The displaydriver 17 then changes the display screen of the liquid crystal display18 to the next screen, which is an editing screen A, following themessage that “the editing button has been actuated.”

[0077]FIG. 16 shows the editing screen A, which is the same as theinitial screen except that it has a scenario editing button 40, a videoediting button 41, an OK button 42 in place of the replay button 34, andthe editing button 35. When the OK button 42 is actuated, the displaydriver 17 returns the display screen to the initial screen. When thevideo editing button 41 is actuated on the screen A, the microprocessor14 moves to a video mode which actually connects the image files on therecording medium 13.

[0078] When the scenario editing button 40 is actuated on the screen A,the display driver 17 changes the display screen to an editing screen B,as shown in FIG. 17. In the editing screen B, an OK button 45 and avideo editing button 45 a are displayed at the upper right of thescreen, and thumbnail images 46 are displayed in a horizontal line atthe middle level of the screen. A palette area 48 is displayed at thelower right of the screen, and a scroll button 49 for scrolling the linedisplay of the thumbnail images 46 is displayed at the lower left of thescreen.

[0079] The operation of the image editing apparatus as controlled fromthe editing screen B is illustrated in the flow chart of FIG. 9. First,the display driver 17 displays the editing screen B on the liquidcrystal display 18 (step S1). When a thumbnail image 46 is actuated(step S2), the microprocessor 14, first evaluates the image file whichwas thumbnail-selected. The microprocessor 14 then takes the list dataof a scenario file Fse defining the replay embodiment related to theevaluated image file and displays it on a menu 47 (step S3). When anitem on the menu 47 is actuated (step S4), the display driver 17 changesthe display screen to an editing screen C (step S5).

[0080] On the other hand, in editing screen B, when an item on the menu47 or a thumbnail image 46 is dragged and dropped into a palette area 48(step S6), the microprocessor 14 records a new scenario file Fsodefining the replay order on the recording medium 13 (step S7).

[0081] The data structure of the scenario file Fso is shown in FIG. 23.In the data structure, a next data item is stored in a position offsetfrom a leading data item position, which is pointed to by a pointer pb:

[0082] Position 1. Scenario file name

[0083] Position 2. Leading image file name or scenario file name

[0084] Position 3. Second image file name or scenario file name

[0085] Position N+1. Nth image file name or scenario file name

[0086] Position N+2. Finish code

[0087] Every time the thumbnail image 46 or the menu 47 is dropped, themicroprocessor 14 adds the name of the image file or the name of thescenario file to the scenario file data (step S8). Moreover, in theediting screen B, when the palette area 48 is double clicked (i.e.actuated twice in rapid succession) (step S9), the display driver 17changes the display screen to an editing screen E (step S11). Further,in the editing screen B, when the video editing button 45 a is actuated(step S12), the display driver 17 changes the display screen to thevideo editing screen (step S13). The microprocessor 14 repeatedlyexecutes these operations until the OK button 45 is actuated.

[0088] When the OK button is actuated (step S14), the display driver 17returns the display screen to the editing screen A (step S15).

[0089] As described above, the editing screen B is used mainly forcreating a new scenario file Fso.

[0090]FIG. 18 shows the editing screen C, in which a thumbnail image 51of the scenario file menu-selected in the editing screen B, is displayedat the upper left of the editing screen C. Below the thumbnail image 51,a motion REC button 52 and an OK button 53 are displayed.

[0091] On the right upper side of the screen, special effect check boxes54 are displayed in a vertical line. Below the special effect checkboxes 54, an edit box 55 for the number of repetitions is displayed.

[0092] The operation of the image editing apparatus as controlled fromthe edit screen C is illustrated in FIG. 10. First, the display driver17 displays the edit screen C on the display screen (step S16). Themicroprocessor 14 reads out from the recording medium 13 a scenario fileFsc defining the replay condition that was selected from the menu in theediting screen B (step S17). In the editing screen B of FIG. 17, whenthe “addition” column is selected from the menu, the microprocessor 14creates the scenario file defining Fsc. A data structure of the scenariofile Fsc is shown in FIG. 23. In the data structure, a next data item isstored offset from a lead data item, which is pointed to by a pointerpa:

[0093] Position 1. Scenario file name

[0094] Position 2. Name of image file to be associated

[0095] Position 3. Replay starting point

[0096] Position 4. Replay finish point

[0097] Position 5. Replay speed (pause, reverse play and fast forwardand the like are stored with time sequencing information)

[0098] Position 6. Number of replay repetitions

[0099] Position 7. Special effect (fade in, wipe in and the like)

[0100] Position 8. Sound replay condition (sound and the like is storedwith time sequencing information).

[0101] The microprocessor 14 renews the corresponding data in thescenario file each time the special effect check box 54 and therepetition number edit box 55 are changed (step S18). On the other hand,in the editing screen C shown in FIG. 18, when the motion REC button 52is actuated (step 19), the display driver 17 displays the editing screenD in the display screen (step S20). The microprocessor 14 repeatedlyperforms these steps until the OK button 53 is pressed.

[0102] On the other hand, in the editing screen C, when the OK button 53is actuated (step S2 1), the display driver 17 returns the displayscreen to the editing screen B (step S22).

[0103] As described above, in the editing screen C, the data renewal of“scenario file defining the replay condition” is mainly executed on theediting screen C.

[0104]FIG. 19 shows the editing screen D, illustrating a replay screen60, which is displayed on the left side of the screen. Below the replayscreen 60, in order from left to right, a fast reverse button 62, areverse button 61, a stop button 63, a pause button 64, a replay button65 and a fast forward button 66 are displayed. An OK button 67 islocated at the upper right of the screen. A start setting button 68, astop setting button 69, and a confirmation button 70 are displayed atthe middle of the right side of the screen. At the lower right of thescreen, a time display box 71 displays the replay time, and a soundadjustment bar 72 adjusts the replay sound.

[0105] The operation of the image editing apparatus as controlled fromthe editing screen D is illustrated in a flow chart shown in FIG. 11.First, the display driver 17 displays the editing screen D on thedisplay screen (step S25). In the editing screen D, the microprocessor14 takes in the manual replay operation of the replay button 65 or thelike. The microprocessor 14 reads out the image files of originalsrelated to the scenario file menu-selected in the editing screen B fromthe recording medium 13. Images in the image files that have been readout are decompressed and stored in the image memory 16 in order of theirreadout by the image compression/decompression circuit 15. The displaydriver 17 replays the images from the image memory 16 according to acommand of the replay condition given by the microprocessor 14.

[0106] For example, when the fast forward button 66 is pressed, thedisplay driver 17 reads out an image every several frames from the imagememory 16 and displays those images on the replay screen 60 in order.When the pause button 64 is pressed, the display driver 17 repeatedlyreads out an image for one frame from the image memory 16, and displaysthe image on the replay screen 60.

[0107] During the replay period, when the start setting button 68 isactuated, the microprocessor 14 stores a frame number of the imagedisplayed on the replay screen 60 at a current point in the data area ofthe replay start point in the scenario file. From this point, themicroprocessor 14 stores the change of the replay speed in the replayspeed data area of the replay scenario file.

[0108] When the sound adjustment bar 72 is operated, the microprocessor14 stores the change of the replay sound amount in the sound replaycondition data area of the scenario file. When the stop setting button69 is actuated, the microprocessor 14 stores the frame number of animage displayed on the replay screen 60 at the current point in thereplay stop point data area of the scenario file (step S26). Themicroprocessor 14 repeatedly performs this series of operations untilthe OK button 67 is actuated. When the OK button 67 is actuated (stepS27), the display driver 17 returns the display screen to the editingscreen C (step S28). Thus, in the editing screen C, the manual replayoperation is automatically recorded in the scenario file.

[0109]FIG. 20 shows the editing screen E. In the editing screen E, an OKbutton 76 is displayed at the upper right of the screen, and thumbnailimages 75 are displayed on several lines in the middle of the screen. Inthe lower left portion of the screen, a scroll button 77 that scrollsthe line display of the thumbnail images 75 and a replay operationbutton 78 for confirmation are displayed.

[0110] The operation of the preferred embodiment as controlled from theediting screen E will be explained with reference to a flow chart shownin FIG. 12. First, the display driver 17 displays the editing screen Eon the display screen (step S30). Next, the microprocessor 14 receivesthe scenario file that was created using the palette area 48 of theediting screen B. The display driver 17 line-displays the thumbnailimages 75 according to the replay order defined by the scenario file(step S3 1). When one thumbnail image 75 is dragged, the display driver17 changes the position of the thumbnail image 75 by following themovement of the drag operation.

[0111] Moreover, when the thumbnail image 75 is dropped between the twothumbnail images, the thumbnail image 75 is inserted between the twothumbnail images, and positions of all the thumbnail images 75 may beshifted (step S32). The microprocessor 14 changes the data itemindicating the replay order in the scenario file to correspond to thenew order of the thumbnail image 75 (step S33). The microprocessor 14repeatedly executes this series of operations until the OK button 76 ispressed.

[0112] When the OK button 76 is actuated (step S34), the display driver17 returns the display screen to the editing screen B (step S35). In theediting screen E, the data showing the replay order in the scenario filecan be changed easily as described above.

[0113] Moreover, during the editing operation, when the replay operationbutton 78 for confirmation shown in FIG. 20 is selected, themicroprocessor 14 creates a sub-window for the replay screen, and theimage files are replayed in order according to the current replay orderin that sub-window.

[0114]FIG. 21 shows the display screen during replay. On the displayscreen, a large replay screen 80 is displayed and a replay operationbutton 82 is displayed below the replay screen 80.

[0115] The replay operation of the embodiment will be explained withreference to the flow chart shown in FIG. 13.

[0116] First, the display driver 17 displays the screen frame of thereplay screen 80 (step S41).

[0117] Next, the microprocessor 14 determines whether the file that wasthumbnail-selected in the initial screen was an image file or scenariofile (step S42).

[0118] When the image file is thumbnail-selected, the microprocessor 14reads out the image files from the recording medium 13 via the diskdrive 12 (step S43). The image compression/decompression circuit 15decompresses the data of the image files, and successively stores thedata in the image memory. The display driver 17 successively displaysthe image information from the image memory 16 on the replay screen 80(step S44). The display driver 17, after replaying the image files,returns the display screen to the initial screen (step S45).

[0119] On the other hand, in step S42, if a scenario file isthumbnail-selected, the microprocessor 14 evaluates whether the replayorder or the replay condition is requested, based on the data structureof the scenario file (step S46).

[0120] When the scenario file requests a replay condition, themicroprocessor 14 reads out the scenario file and the image files of therelated originals from the recording medium 13 via the disk drive 12(step S47). Next, the microprocessor 14 gets the replay start point dataitem and the replay finish point data item from the data structure ofthe scenario file, and transfers the replay start point and the finishpoint data item to the image compression/decompression circuit 15. Theimage compression/decompression circuit 15 decompresses the image filedata before and after the replay start frame, and successively storesthe image file data in the image memory 16. The display driver 17transfers the frame number of the image in the image memory 16 to themicroprocessor 14. The microprocessor 14 transmits the replay speed inthe scenario file, the replay condition of sound, and special effects tothe display driver 17 according to the frame number. The display driver17 changes the frame display time period, the replay condition of sounddata included in the image file and the special effects in response to acommand from the microprocessor 14 (step S48). The imagecompression/decompression circuit 15 completes the decompression of theimage file and decompresses the frame of the replay stop point. Thedisplay driver 17 returns the display screen to the initial screen aftercompleting the replay of the image in the image memory 16 (step S49).

[0121] On the other hand, in step S46, if it is determined that thescenario file defines the replay order, the microprocessor 14 reads outthe scenario file from the recording medium 13 via the disk drive 12.The microprocessor 14 follows the replay order step by step, andprocesses the data of the replay order in a memory inside themicroprocessor 14 (step S50).

[0122] In short, as shown in FIG. 24, the data corresponding to (imagefile B+scenario file C+image file D) is recorded in the scenario file A.The microprocessor 14 reads out the scenario 2 0 file C that defines thereplay order. In the scenario file C, the data corresponding to (imagefile E +image file F+scenario file G) is recorded. Since the scenariofile G defines the replay condition, the replay order is not followedany further. As a result, the replay order stored on the memory becomes:(image file B+image file E+image file F+scenario file G+image file D).

[0123] The microprocessor 14 finds the connected parts of the scenariofile that defines the replay condition, and evaluates whether aninconsistency has arisen in the special effects or the like of theconnected parts, based on, for example, a predetermined comparison chart(step S5 1).

[0124] For example, when a fadeout and a wipe-in are both requested, aninconsistency occurs. When this happens, the microprocessor 14 deletesthe appropriate data item of the later scenario file in order toprioritize the special effect of the preceding scenario file (step S52).The microprocessor 14 over-writes the corrected scenario file onto therecording medium 13 (step S53). With the inconsistency resolved, themicroprocessor 14, the image compression/ decompression circuit 15 andthe display driver 17 replay the image files or the scenario file inorder according to the replay order stored in the memory (step S54). Thedisplay driver 17 returns the display screen to the initial screen aftercompleting the replay of the images in the image memory 16 (step S55).

[0125]FIG. 22 shows the video editing screen. On the video editingscreen, a large main screen 84 is displayed, and an OK button 85, a filemenu 86 and a special effect menu 87 are all displayed on a right sideof the main screen 84. A selection menu of trimming adjustment, additionof a specified screen frame and a color tone adjustment, for example, isdisplayed by selecting an option from the special effect menu 87. Belowthe special effect menu 87, a file list 88 is displayed that lists thescenario files. At the lower right of the main screen 84, a sub-screen89 is displayed for confirming a screen effect from the special effectmenu 87. At a lower left of the main screen, a recording button 90 and areplay button 91 are displayed. The replay button 91 has the samefunction as the replay operation button 82 in the replay screendescribed above with reference to FIG. 21.

[0126] The operation of the preferred embodiment of the image editingapparatus in connection with the recording button 90 will be explainedbased on a flow chart shown in FIG. 14. First, the microprocessor 14gets the file names of the scenario files via the disk drive 12, andlists the file names in a file list 88 (step S61). Next, themicroprocessor 14 obtains the manual selection of the file list 88 viathe touch panel 18 a (step S62). This operation is repeated until therecording button 90 is pressed. However, during this period, if thereplay button 91 on the special effect menu 87 or the like is operated,the microprocessor 14 carries out the commanded operation.

[0127] If the recording button 90 is pressed (step S63), themicroprocessor 14 evaluates whether the selected scenario file defines areplay order or a replay condition, based on the data structure of thescenario file (step S64). If the scenario file defines a replaycondition, the microprocessor 14 reads the scenario files and the imagefiles of related originals from the recording medium 13 (step S65).

[0128] Next, the microprocessor 14 takes in the replay start point dataitem and the replay finish point data item from the data structure ofthe scenario file, and transfers them to the imagecompression/decompression circuit 15. The compression/decompressioncircuit 15 stores the image file data in the image memory 16 bydecompressing data from frames before and after the frame of the replaystarting point. The display driver 17 transfers the frame number of theimage in the image memory 16 to the microprocessor 14. Themicroprocessor 14 transfers corresponding data such as the replay speedin the scenario file, the replay condition of sound and a special effectto the display driver 17 according to the frame number. The displaydriver 17 changes the time period of the frame display, replay conditionof sound data included in the image file, and the special effect and thelike in synchronization with the corresponding data.

[0129] The image data that has been processed based on the scenario fileis replayed and displayed on the main screen 84, and saved successivelyin the image memory 16 (step S66). In the image memory 16, each time theprocessed image data is saved for a predetermined period, the imagecompression/decompression circuit 15 temporarily suspends thedecompression operation, and compresses the image data.

[0130] The disk drive 12 records a new image file on the recordingmedium 13, and stores the images one by one after compressing the imagefile (step S67). The image compression/decompression circuit 15completes the decompression of the image file when the decompressionoperation of the replay stop point is reached. The display driver 17waits for the storing of the image data to be completed, and thenreturns the display screen to the initial screen (step S68).

[0131] On the other hand, in step S64, when the scenario file defines areplay order, the microprocessor 14 reads out the scenario file from therecording medium 13 via the disk drive 12. The microprocessor 14 followsthe replay order in steps as shown in FIG. 24, and processes the replayorder data in the memory inside of the microprocessor 14 (step S69). Themicroprocessor 14 searches for associated parts of scenario files thatdefine a replay condition, and evaluates whether an inconsistency hasoccurred in the special effects or the like based on a predeterminedcomparison chart (step S70).

[0132] If an inconsistency occurs, the microprocessor 14 deletes theappropriate data item of a later scenario file in order to prioritizethe special effect of a preceding scenario file (step S71). Themicroprocessor 14 then stores the corrected scenario file to therecording medium 13 (step S72). With the inconsistency resolved, themicroprocessor 14 reads out the image files according to the replayorder via the disk drive 12.

[0133] The image data in the image files that have been read out inorder based on the scenario file is connected successively in the imagememory 16, and is replayed and displayed on the main screen 84 (stepS73). The image data thus connected are output to the disk drive 12 oneby one after being image compressed one by one by the imagecompression/decompression circuit 15.

[0134] The disk drive 12 stores new image files on the recording medium13, and stores the connected image data in the image files one by one(step S74). After storage of the connected image data is complete, thedisplay driver 17 returns the display screen to the initial screen (stepS75).

[0135] As explained above, in the preferred embodiment of the presentinvention, since the replay order is reconstructed from the followingscenario file in a hierarchical manner, the file structure can besimplified. Moreover, a scenario file that has already been edited canbe assembled in its existing form into a scenario file. Accordingly, itis not necessary to make an intermediate step of creating the image fileduring the editing operation. As a result, storage capacity of therecording medium can be used effectively and without waste.

[0136] Moreover, since the scenario file is created by automaticallyrecording the manual replay operation, creation of the scenario file iseasy. Also, since the scenario file can be created based on high-levelediting operations, complex editing operations which cannot bedesignated by a manual replay operation can be included in the scenariofile. Further, since inconsistencies in the scenario file are correctedautomatically, based on a predetermined priority order, the image filescorresponding to a particular scenario file can be edited at any time.

[0137] Moreover, since the scenario files defining the replay conditionand the replay order are separated, the data structure of the scenariofile is simple and allows for a reduction in the amount of informationprocessing. Furthermore, since the replay of image files can beperformed by reading out the scenario file, the editing operation can beperformed with a rapid confirmation of the editing result.

[0138] Moreover, a camera component 11 a captures the image to be storedin the image file. It is therefore possible to create the scenario filefor the image file corresponding to the captured image immediately afterphotographing. Accordingly, the inconvenience of having to perform theediting operation while remembering the photograph contents after timehas passed can be eliminated.

[0139] In the preferred embodiment, the scenario files defining thereplay condition and the replay order are separated. However, it ispossible to include both in one scenario file. Moreover, the image filesand the scenario file are separated in the preferred embodiment, but itis possible to record the scenario file as part of the image files.

[0140] Furthermore, although a magneto-optical recording medium is usedas the recording medium in the preferred embodiment, any recordingmedium, such as magnetic, semiconductor, or optical media may be used.

[0141] Further, although in the preferred embodiment the image files andthe scenario files are recorded on the same recording medium, thescenario files and the image files can be separately recorded ondifferent recording media.

[0142] Moreover, although the above embodiment describes recording theedited image files on the recording medium on which the original imagefiles recorded, the edited image files can be recorded on a differentrecording medium.

[0143] Further, when the scenario file has an inconsistency, thepreceding image replay is automatically prioritized; however, it ispossible to automatically prioritize succeeding image replay, or topredetermine the priority for various types of inconsistencies. It isalso possible to receive a prioritization order from the outside via thetouch panel 18 a at the time of an occurrence of the inconsistency.

[0144] Further, the inconsistency in the scenario file is automaticallycorrected at the time of replay or video editing, however, it ispossible to automatically correct the inconsistency of the scenario fileduring the editing operation shown in FIG. 24, or to simply warn theuser when the inconsistency occurs. Thus, it is possible to find theinconsistency quickly, and to correct the inconsistency quickly andeasily during the editing of the scenario file.

[0145] Some examples of the replay conditions (including the specialeffects) are described, however, the replay conditions may be anythingthat indicates a condition shown on the screen or sound at the time ofreplay condition.

[0146] Moreover, it is possible that the image files will bephotographed at a future time by the camera 11 a or the like (i.e. theimage file may not yet exist at that point in time), and to add a filecontroller that treats this type of image files as if they alreadyexisted. By adding such a file controller, it is possible to combine theimage files that will be photographed later to replay order data and thelike in the scenario file in advance.

[0147] Accordingly, it is possible to make the scenario file in advance,following a photography plan such as a picture conte (i.e. a picturesketch sequence that roughly relates to plot or sequence of, forexample, a movie, or a story, or a segment thereof). By preparing thescenario file in advance, not only can a series of photographs becompleted, but an almost-edited film work can be completed as well.

[0148] As explained above, automatic editing of the image files isperformed according to the replay order or the replay condition ofscenario files. Usually this kind of a scenario file is constructedcentered mainly around the replay order data or the replay conditiondata. This can be done when the information amount is small compared tothe image file that includes the image information itself. Accordingly,the recording capacity of the recording medium can be used effectively.

[0149] An editing operation by the user can be done even if performed onnewly created scenario files or on new data. As a result, there is lessneed to preserve the image files one by one in intermediate steps duringthe editing. Accordingly, in addition to increasing the speed of theediting operation, the recording capacity of the recording medium isused effectively and without waste.

[0150] Since the preferred embodiment of the present invention evaluatesthe replay order by following the scenario file in a hierarchical order,the file structure can be simplified for each scenario file. Moreover,the reusability of the scenario file is extremely high since the editedscenario file is assembled in a hierarchical manner in the scenariofile.

[0151] Further, the scenario file of a final film work can be structuredsuch that scenario files are divided and edited for every scene in ahierarchical manner. Accordingly, in editing operations by the editor, ascenario file is made for every scene, and the scenario files may bejoined into an appropriate sequence. Therefore, there is less need tomake the image files one by one and preserve them for each scene, and itis possible to use the recording capacity of the recording mediumeffectively and without waste. Therefore, the image editing apparatus ofthe present invention is suitable for performing an image edit for eachscene.

[0152] The present invention also makes the scenario file byautomatically recording the manual replay operation, and thus can easilycreate scenario files. Since the present invention makes the scenariofiles based on the editing operation, creation of high quality scenariofiles is possible by designating complex editing operations.

[0153] The present invention automatically corrects an inconsistency inthe scenario file according to predetermined prioritization order or acorrection instruction. Therefore, even if the scenario file has aninconsistency, the image editing can still be performed.

[0154] In this preferred embodiment, the reproduction start time pointand the reproduction end time point are recorded in the correspondingdata areas in terms of the frame number of the image. However, it is notalways necessary to record the frame number in the data areas. Forexample, time stamp data, which are included in the MPEG type image filein addition to image data, may be written on the data areas instead.

[0155] The present invention can also approximately confirm the imagefile after edit completion at the scenario file level.

[0156] Also, the reproduction start point and the reproduction end pointmay be stored in the image file itself instead of being stored in thescenario file.

[0157] While the invention has been described in detail and withreference to specific embodiments thereof, it will be apparent to thoseskilled in the art that various changes and modifications can be madetherein without departing from the spirit and scope thereof. Thus, it isintended that the present invention cover the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. An image editing apparatus, comprising: arecording medium for storing an image file and a scenario file, whereinthe scenario file is formed by recording a replay order or a replaycondition of the image file with a predetermined file format; a scenarioevaluating circuit for reading the scenario file from the recordingmedium and evaluating the replay order or the replay condition; and aneditor for editing the image file in response to an evaluation by thescenario evaluating circuit.
 2. The image editing apparatus of claim 1,further including a recorder for recording the image file on therecording medium.
 3. The image editing apparatus of claim 1, wherein thescenario file comprises at least one of a replaying speed of the imagefile, a number of repetitions for replaying the image file, a replayrange of the image file, a special effect, and a replay of soundassociated with the image file.
 4. The image editing apparatus of claim1, wherein the scenario file includes identification data indicating ifother scenario files are recorded as part of the scenario file; andwherein the scenario evaluating circuit evaluates the replay order ofthe image files by following the corresponding scenario file in ahierarchical manner based on the identification data.
 5. The imageediting apparatus of claim 1, further including: a manual replay circuitfor replaying the image files recorded in the recording medium accordingto an external replay operation; and a first scenario editor thatrecords a sequence of manual steps as a replay order or replay conditionin the scenario file.
 6. The image editing apparatus of claim 1, furtherincluding: an edit input unit for receiving the editing operation forthe plurality of image files, and a second scenario making editor forrecording a replay order or a replay condition as a scenario file basedon the editing operation received from the editing input unit.
 7. Theimage editing apparatus of claim 1, further including a corrector fordetecting an inconsistency when the plurality of image files is replayedalong with the scenario file, and for correcting the inconsistencyaccording to one of a predetermined priority order or an externallyinput correction instruction.
 8. The image editing apparatus of claim 1,wherein a replay mechanism replays image files take in from therecording medium according to the replay order or the replay conditionevaluated by the scenario evaluating circuit.
 9. The image editingapparatus of claim 1, wherein the recording medium further includes afirst recording medium for storing the image file and a second recordingmedium for storing the scenario file.
 10. An image recording and editingapparatus, comprising: a camera; a recording medium; a recorder; animage file representing an image acquired by the camera and stored onthe recording medium by the recorder; a scenario file stored on therecording medium; a display; and a controller for controlling thedisplay according to instructions stored in the scenario file and forcontrolling the recording of the images in the image file.
 11. The imagerecording and editing apparatus of claim 10, further including: a lensfor forming the image in the camera; and an imaging element forconverting the image into digital form.
 12. The image recording andediting apparatus of claim 10, further including: a common data bus; amicroprocessor connected to the common data bus; an image memoryconnected to the common data bus; a compression/decompression circuitconnected to the common data bus; a display driver connected to thecommon data bus; and a disk drive connected to the common data bus. 13.The image recording and editing apparatus of claim 10, wherein therecorder includes a disk drive.
 14. The image recording and editingapparatus of claim 13, wherein the disk drive is an optical disk drive,and the recording medium is an optical recording medium.
 15. The imagerecording and editing apparatus of claim 10, wherein the controller is amicroprocessor-based controller.
 16. The image recording and editingapparatus of claim 10, further including a control panel interfacingwith the controller.
 17. The image recording and editing apparatus ofclaim 10, further including an image compression/decompression circuitfor compressing/decompressing the images.
 18. The image recording andediting apparatus of claim 10, further including a display driver todrive the display.
 19. The image recording and editing apparatus ofclaim 10, wherein the scenario file is formed by recording at least oneof a replay order or a replay condition of the image file.
 20. The imagerecording and editing apparatus of claim 10, wherein the scenario filecomprises at least one of a replaying speed of the image file, a numberof repetitions for replaying the image file, a replay range of the imagefile, a special effect, and a replay of sound associated with the imagefile.
 21. The image recording and editing apparatus of claim 10, whereinthe scenario file further optionally includes identification dataindicating if other scenario files are recorded as part of the scenariofile; and wherein the recording an editing apparatus further optionallyincludes a scenario evaluating circuit for evaluating the replay orderof the image files by following the corresponding scenario file in ahierarchical manner based on the identification data.
 22. The imagerecording and editing apparatus of claim 10, further including: a manualreplay circuit for replaying the image files recorded in the recordingmedium according to an external replay operation; and a first scenariomaking editor that automatically records a sequence of manual steps as areplay order or replay condition in the scenario file.
 23. The imagerecording and editing apparatus of claim 10, further including: an editinput unit for receiving the editing operation for the plurality ofimage files, and a second scenario making editor that records a replayorder or a replay condition as a scenario file based on the editingoperation input via the edit input unit.
 24. The image recording andediting apparatus of claim 10, wherein the controller resolvesinconsistencies in the scenario file according to one of a predeterminedpriority order or an externally supplied instruction.
 25. The imagerecording and editing apparatus of claim 10, wherein thumbnail imagesare displayed on the display to represent image files and scenariofiles.
 26. The image recording and editing apparatus of claim 10,further including external controls for controlling display of images onthe display, and wherein the controller further edits the image files inresponse to the external controls.
 27. An image recording and editingapparatus, comprising: a camera; an image memory for storing imagesreceived by the camera and connected to a common data bus; a recordingmedium; a disk drive positioned to record data on the recording mediumand connected to the common data bus; a display for displaying imagesreceived by the camera; a display driver for driving the display andconnected to the common data bus; microprocessor connected to the commondata bus for controlling the display in response to a scenario file,wherein the images are recorded on the recording medium as image filesby the recorder in response to commands from the controller andinstructions stored in a scenario file; and a compression/decompressioncircuit connected to the common data bus.
 28. The image recording andediting apparatus of claim 27, further including: a plurality of imagefiles; a plurality of scenario files, wherein each image has acorresponding scenario file, and wherein the plurality of scenario filesand the plurality of image files are arranged hierarchically.
 29. Amethod of capturing and editing images, comprising the steps of:capturing a first image; storing the first image on a recording medium;creating a control instruction; storing the control instruction as ascenario file; and displaying the first image, wherein the first imageis modified according to the scenario file.
 30. The method of claim 29,further including the steps of: capturing a plurality of images; storingthe plurality of images on the recording medium; and creating aplurality of control instructions, wherein each of the plurality ofimage files has a corresponding control instruction.
 31. The method ofclaim 30, further including the step of creating a plurality of scenariofiles, wherein each of the plurality of scenario files corresponds to atleast one of the plurality of image files.
 32. The method of claim 3 1,wherein the plurality of scenario files are constructed in ahierarchical manner.
 33. The method of claim 29, wherein the step ofcreating the control instruction includes the step of creating ascenario file and storing the scenario file on the recording medium. 34.The method of claim 33, wherein the step of creating the scenario fileincludes a step of storing a plurality of instructions in the scenariofile.
 35. The method of claim 34, wherein the step of displaying thefirst image includes a step of resolving possible inconsistenciesbetween each one of the plurality of instructions in the scenario file.36. The method of claim 33, wherein the step of creating a scenario fileincludes the step of storing the scenario file on the recording medium.37. The method of claim 29, wherein the step of capturing the firstimage captures the first image with a camera.
 38. The method of claim29, wherein the step of storing the first image on a recording mediumstores the image on a magneto-optical recording medium.
 39. The methodof claim 29, wherein the step of storing the first image on a recordingmedium stores the image on a disk-shaped recording medium using a diskdrive.
 40. The method of claim 29, wherein the step of capturing thefirst image includes a step of compressing a digital representation ofthe first image.
 41. The method of claim 29, wherein the step ofcreating the control instruction creates the control instruction inresponse to an external input.
 42. The method of claim 29, wherein thestep of creating the control instruction includes recalling aninstruction from memory by a microprocessor.
 43. The method of claim 29,wherein the step of displaying the first image includes the step ofdecompressing a digital representation of the image stored as an imagefile on the recording medium.
 44. The method of claim 29, wherein thecontrol instruction includes at least one of a replay, a delay, aspecial effect, or a replay order.
 45. An image reproducing apparatus,comprising: a memory for storing an image file including moving imagedata and a scenario file, wherein the scenario file includes areproduction start point and a reproduction end point of the movingimage data of the image file; and a reproducer for reproducing themoving image data in accordance with the reproduction start point andthe reproduction end point.
 46. The image reproducing apparatusaccording to claim 45, wherein the scenario file includes frame numberinformation corresponding to frame numbers of the moving image data. 47.The image reproducing apparatus according to claim 45, wherein the imagefile includes time stamp data, and the scenario file includes timeinformation corresponding to the time stamp data.
 48. An imagereproducing apparatus, comprising: an image file including moving imagedata, a reproduction start point of the moving image data, and areproduction end point of the moving image data; a memory for storingthe image file; and a reproducer for reproducing the moving image datain accordance with the reproduction start point and the reproduction endpoint.
 49. The image reproducing apparatus of claim 48, furtherincluding a scenario file stored in the memory, wherein the scenariofile includes at least one of a replaying speed of the image file, anumber of repetitions for replaying the image file, a replay range ofthe image file, a special effect, and a replay of sound associated withthe image file.
 50. An image reproducing apparatus, comprising: a memoryfor storing moving image data, a reproduction start point of the movingimage data, and a reproduction end point of the moving image data; and areproducer for reproducing the moving image data in accordance with thereproduction start point and the reproduction end point.
 51. The imagereproducing apparatus of claim 50, wherein the moving image data isstored in an image file, and the reproduction start point of the movingimage data and the reproduction end point of the moving image data arestored in a scenario file.
 52. The image reproducing apparatus of claim50, wherein the moving image data, the reproduction start point of themoving image data and the reproduction end point of the moving imagedata are stored in an image file, wherein the image file is stored inthe memory.
 53. The image reproduction apparatus of claim 52, furtherincluding a scenario file stored in the memory, wherein the scenariofile includes at least one of a replaying speed of the image file, anumber of repetitions for replaying the image file, a replay range ofthe image file, a special effect, and a replay of sound associated withthe image file.